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Abstract 

For  special  model  problems,  Fourier  analysis  gives  exact  convergence  rates  for  the 
two-grid  multigrid  cycle  and,  for  more  general  problems,  provides  estimates  of  the  two- 
grid  convergence  rates  via  local  mode  analysis.  A  method  is  presented  for  obtaining 
multigrid  convergence  rate  estimates  for  cycles  involving  more  than  two  grids  -  using 
essentially  the  same  analysis  as  for  the  two-grid  cycle. 

For  the  simple  case  of  the  V-cycle  used  as  a  fast  Laplace  solver  on  the  unit  square,  the 
A:-grid  convergence  rate  bounds  obtained  by  this  method  are  sharper  than  the  bounds 
predicted  by  the  variational  theory.  Both  theoretical  justification  and  experimental 
evidence  are  presented. 
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1.  Introduction 


Although  the  heuristic  arguments  which  indicate  that  multigrid  iterative  methods  lead  to  fast  ellip¬ 
tic  solvers  are  easy  to  understand,  they  cannot  predict  convergence  rates  or  guarantee  convergence. 
There  exist  methods  which  provide  a  means  to  calculate  theoretical  multigrid  convergence  rate 
bounds  for  a  large  class  of  multigrid  solvers  for  positive  definite  elliptic  problems.  Unfortunately, 
the  motivation  and  proofs  of  these  bounds  are  relatively  difficult.  For  special  model  problems,  a 
simpler  calculation,  based  on  Fourier  analysis,  provides  exact  convergence  rates  for  the  two-grid 
algorithm,  but  the  exact  analysis  becomes  too  complicated  to  carry  out  for  more  than  two  or  three 
grids. 

In  this  paper  we  present  a  technique  for  obtaining  convergence  estimates  for  any  number  of  grid 
levels,  thereby  providing  an  easy  method  to  verify  that  multigrid  is  a  fast  solver  (i.e.,  only  a  fixed 
number  of  iterations  will  solve  the  problem).  Although  the  method  is  strictly  valid  for  only  a  few 
model  problems  and  for  onl)  symmetric  V -cycles,  it  provides  a  general  insight  into  the  details  of 
the  basic  interaction  between  the  coarse  grid  correction  and  the  relaxation.  These  new  estimates 
of  the  convergence  rates  for  the  fc-grid  problem  are  no  more  difficult  to  calculate  than  the  exact 
convergence  rates  for  the  two-gnd  problem. 

In  Section  2  we  define  a  simple  multigrid  U-cycle  and  derive  a  formula  for  the  iteration  matrix 
associated  with  a  multigrid  cycle.  A  brief  introduction  to  the  grid  independent  convergence  rate 
bounds  given  by  the  variational  theory  is  given  in  Section  3.  In  Section  4  it  is  shown  that  bounds 
on  the  k  grid  convergence  rate  can  be  found  in  terms  of  the  k  —  1  grid  convergence  rate,  using  the 
same  type  of  calculation  as  for  obtaining  the  exact  two  grid  convergence  rates.  Moreover,  since  the 
two  grid  convergence  rate  can  be  found  exactly,  we  obtain  convergence  rate  bounds  recursively  for 
any  number  of  grid  levels.  It  is  shown  that  these  bounds  are  sharper  than  those  obtained  by  the 
variational  theory.  In  Section  5  we  show  the  details  of  how  the  results  of  Section  4  can  be  used  to 
obtain  convergence  rates  for  a  model  problem.  Finally,  in  Section  6,  we  compare  the  convergence 
rate  bounds  predicted  by  our  theory  and  the  convergence  rate  bounds  given  by  the  variational 
theory.  The  exact  three  grid  convergence  rates  are  compared  to  our  three  grid  convergence  rate 
bounds. 


PTi': 

:  P-  n  ; 
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2.  Notation 


2.1  Multigrid  Cycle 

A  sequence  of  uniform  grids  is  given  with  mesh  sizes  hk  {k  =  1,2,3,...),  where  hk+i  =  hk/2. 
Consider  the  discrete  equations  on  the  h*  grid  of  the  form 

AkUk  =  Fk  (1) 

where  A*  is  symmetric,  positive  definite.  Given  an  approximate  solution  to  (1),  the  multigrid 
ry-u  ivfG  for  producing  an  improved  approximation 

u[^^^MG{k,u]^\Fk)  (2) 

is  recursively  defined  as  follows: 

If  A:  =  1  solve  (1)  by  any  direct  or  iterative  method,  yielding  the  final  result  Otherwise  do 

(A)  through  (E). 

(A)  Perform  ri  relaxation  sweeps  on  (1),  resulting  in  a  new  approximation  u*. 

(B)  Transfer  (“restrict”)  residual  from  grid  hk  to  grid  hk-i- 

Fk-i  =  -  AkUk).  (3) 

(C)  Starting  with  =  0,  update  coarse  grid  approximation. 

4-1  -  MG(k  -  l,4°li,^J-‘(n  -  A»li,)).  (4) 

(D)  Calculate  u*  =  u*  +  where  is  a  suitable  interpolation  (“prolongation”)  from 

grid  hk-i  to  grid  hk- 

(E)  Perform  r2  relaxation  sweeps  on  (1),  starting  with  u*  and  yielding  the  final  result 
This  cycle  is  called  V-  cycle  or  V'(ri,r2). 

Note:  The  relaxations  done  in  steps  (A)  and  (D)  need  not  be  the  same. 

2.2  '  Error  Analysis 

As  in  the  analysis  of  the  classical  fixed  point  linear  iterative  solvers,  we  are  interested  in  analyzing 
the  “iteration  matrix”  associated  with  the  multigrid  process.  If  the  error  after  the  I'-th  iteration 
can  be  written  in  terms  of  the  error  before  the  i-th  iteration  as: 

Uk  -  uW  =  BkiUk  -  u^'^)  (5) 

2 


then  Bic  is  the  iteration  matrix.  We  are  interested  in  the  convergence  factor  of  the  V-  cycle,  fjt, 
given  by 

£*  =  {nf{e:\\Uk-MG{k,vt,Ft)\\<e\\Uk-vt\\  Vvt  6  if*}  (6) 

=  inf{€  :  ||5fcu;fc||  <  cl|ti;fcj|  Vwt  e  Ht} 

=  l|5*(| 

where  ||  •  ||  is  some  norm  defined  on  Ht,  the  space  of  all  vectors  defined  on  the  grid  h^- 

To  find  an  expression  for  the  iteration  matrix  corresponding  to  a  V-  cycle,  the  steps  (A)-(E) 
are  rewritten  in  terms  of  the  errors  {true  solution  —  current  approximation).  Given  an  initial 
error,  the  iteration  matrix  is  defined  recursively  as  follows; 

If  fc  =  1,  then  Bi  —  0  (the  error  is  eliminated  completely  on  the  coarsest  grid).  Otherwise 

(^) 

where  the  error  of  the  improved  approximation  is  given  by  steps  (A')-(E'): 

(A')  After  relaxation; 

e/b  = 

where  Gk  is  the  iteration  matrix  of  the  (pre-) relaxation. 

(B')  After  residual  transfer: 

[ft-i  =  A;^jlj^-Ukek. 

(C)  After  computing  coarse  grid  correction,  since  =  l/k-i' 

4-1  =  ■8fc-i4-i- 

(O')  After  interpolating  correction  to  fine  grid: 

^fc-l\^t-l  ^k~l) 

=  h  - 

(E*)  After  relaxation: 

where  Ek  is  the  iteration  matrix  of  the  (post-)relaxation. 
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Therefore  for  1  <  A:  <  m, 

Bk  =  {EkYHl  -  /ti(/  -  Bk-i)A^l,lj^-^Ak){Gky^  (8) 

and 

Si  =  0. 

3.  Variational  Theory 

3.1  Notation 

Consider  the  Euclidean  spaces  Hk  =  iR"*,  Ar  =  1,  2,  •••,  m  and  two  types  of  inner  products  on 
these  spaces,  one  type  is  the  usual  discrete  L*  inner  product  in  d-dimensions  defined  as 

(ufc,Vk)fc  =  hiYi{^k)i{vk)i 

i 

and  the  other  is  the  “energy”  or  “operator”  inner  product  (associated  with  an  operator  L*)  defined 
as 

i^k,Vk)k=^  {uk>BkVk)k-  (9) 

The  norms  induced  by  these  inner  products  are  denoted  by; 

||«*IU  = 

and 

Adjoints  relative  to  the  (•,  •)  inner  products  are  denoted  by  (•)^  and  adjoints  relative  to  the  (•,  •) 
inner  products  are  denoted  by  (■)*. 

3.2  Bounds  Independent  of  the  Number  of  Levels 

The  best  available  multi-level  convergence  rate  bounds  come  from  the  analysis  in  the  “variational” 
setting,  i.e.,  where  it  is  assumed  that; 

a.  The  intergrid  transfer  operators  are  related  by; 


and 
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b.  the  “Galerkin”  choice  of  the  coarse  grid  operators  is  assumed: 

For  the  complete  theory  for  general  domains  and  W-  as  well  as  V-cycles,  see  [3].  For  positive 
definite  symmetric  elliptic  p.d.e.’s  in  the  unit  square,  typical  V-cycle  convergence  rate  bounds 
which  are  independent  of  the  number  of  coarse  grids  are  summarized  below.  For  a  more  complete 
discussion  of  the  types  of  convergence  proofs,  see  [6]. 

As  in  the  standard  variational  multigrid  analysis,  see  e.g.,  [4],  [5]  and  [l],  define  two  operators. 


5*  and  T*: 

•S'*  —  ^t-i^t-i^k 

(10) 

and 

II 

1 

(11) 

Then  St  and  Tt  are  orthogonal  projections  in  the  (•,•)  inner  product.  Specifically: 

1-  SkSt  =  St,  TtTt  =  Tt  and  7*5*  =  5*T*  =  0. 

2.  For  any  u*, 

=  TfcU*  +  5*u* 

and  since  S^  =  S*  and  =  T*  (but  5j  ^  5*  and  ^  Tt,  in  general),  we  also  have 

I«»II5  =  Iis,..ii5  +  inu.iiJ.  (12) 

Note:  If  u*  =  5*Ufc,  then  u*  €  range(/^_j),  i.e.  it  is  representable  on  the  h*_i  grid.  If 
vt  =  Ttvt,  then  lj^~^Atvt  =  0,  i.e.  v*  G  nullspace{lj^~^ At)  and  if  v*  corresponds  to  an  error,  its 
residual  cannot  be  distinguished  from  the  null  vector  on  the  ht-i  grid. 

Let  c*  be  the  operator  norm  convergence  factor  of  the  k  grid  V-cycle,  see  equation  (6). 


Theorem  1  If  there  exist  ^1,82  >  0,  independent  of  k,  such  that  for  every  ut 

k  =  2,Z,--, 

ll(G0'‘«*lll + Ain(G»)'-<‘*ll!  <  l«lll 

tn  Ht  and  for  all 

(13) 

and 

(14) 

then  for  every  A:  =  2, 3,  • 

* 

e*<(H-A)-‘/'{l  +  /92)-*/^ 

(15) 
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Proof.  See  [3], 

In  [3],  Theorem  1  is  proved  using  recursive  formulas  of  the  form: 


cy  =  sup  ( 
0«<1 


\  +  &t  ’ 


(16) 


where  j  >  2. 

Although  these  formulas  appear  to  give  grid  dependent  bounds,  notice  that  ey  =  1/(1  +  /?), 
independent  of  j.  Therefore  these  formulas  give  the  same  convergence  rate  bound  for  the  two  grid 
cycle  as  for  an  arbitrary  number  of  grids.  They  cannot  give  sharper  intermediate  estimates  for  a 
specific  number  of  grids.  In  the  next  section  we  show  that,  under  special  assumptions,  one  can  do 
better  than  this. 


4.  Multi-Level  Analysis 

From  equations  (8)  and  (11),  the  two  grid  iteration  matrix,  Bi,  is: 

P2  =  (W’ 72  (Gj)^*.  (17) 

Under  certain  assumptions  about  E^,  l\,  I\  ^2>  it  is  feasible  to  explicitly  calculate  the 
spectral  radius  of  B2  and  hence  find  exact  asymptotic  convergence  rates  for  the  two  grid  algorithm. 
Section  5  contains  the  details  of  the  calculation  of  the  spectral  radius  of  operators  of  the  slightly 
more  general  form  (Efc)''*(Tt  —  a5t)(G*)'''  where  a  is  a  scalar.  Notice  that  the  two  grid  operator 
is  of  this  form  with  a  =  0.  In  general,  the  fc-grid  V -cycle  iteration  matrix  is  given  by 

B,  =  (is) 

and  is  not  of  this  form  unless,  for  instance,  flfc-i  is  a  constant  multiple  of  the  identity  (i.e.,  all  error 
components  on  the  k  —  1st  grid  are  uniformly  reduced).  It  is  possible,  however,  to  obtain  estimates 
of  the  k  grid  convergence  rates  by  replacing  Bk-i  by  the  constant  |||Pjt_i||t_i  times  the  identity. 
For  convenience,  fix  the  number  of  relaxations,  rj,  and  define 

Gy  =  (Gy)^‘. 

We  assume  the  Ay’s  are  symmetric  and  that  Ay,  Gy  and  Ej  commute. 

Theorem  2  If  ri  =  rj  and  for  every  j  =  l,2,---,fc,  Ej  =  GJ,  then  Bj  is  positive  semi-definite 
and 

|c;t,gj,  <  IS, I,  <  ta-{Ti  +  |b,-,||,.,s,)g,||,.  (19) 
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Proof. 

Since  V-~^  =  Tj  =  (Ty)*  and  Sj  ~  (5y)*,  each  Bj  is  symmetric  with  respect  to  the 

energy  inner  product  (By  =  (Bj)*).  Each  By  is  also  positive  semi-definite.  This  is  most  easily 
seen  by  induction.  B2  is  positive  semi-definite  since  (B2tt;2i <"2)2  =  |||^2^2«^2||2  every  ti;2  e  Hz- 
Assume  By_i  is  positive  semi-definite  for  some  j  >  2.  From  formula  (18), 

(By«;y,«;y)y  =  (G*ryGy«;y,  «;y)y  {G' A^G  ,  Wj)^. 


Since  (Ty)^  =  Ty  for  arbitrary  toy  €  Hj,  we  can  write 

{G  jTjGjWj,Wj)j  =  {TjGjWj,TjGjWj)j 

and,  similarly,  since 

(G;  fj_,By_x  AyGytO,,  tOy)y  =  (B,_i(ATi^/j-‘AyGyU;y),  (Aji^/j^AyGylOy)),.!. 

The  right  hand  side  of  the  previous  equation  is  non-negative  by  the  inductive  assumption  and  thus 


(Bytoy,  «;y)y  =  (PyGylOy,  PyGytOyjy  -f-  (By_.i(A7_\/^-»AyGyU;y),  (Ar_\//-MyGytOy))y_i 


1-1  rJ-1 


>  |||TyGy«;yiJ  >  0. 


(20) 


Therefore  By  is  positive  semi-definite. 

We  can  also  use  equation  (20)  to  obtain  the  lower  bound  for  the  ((By((y’s  in  equation  (19). 

To  prove  the  upper  bound  in  equation  (19),  let  toy  be  an  arbitrary  vector  in  By.  By  the  definition 
and  Sj, 

(G*  //_,  By_i  AT^\  li~^AjGjWj,  Wj)j  = 

< 

Therefore, 

(By«;y,tOy)y  <  ((G'TyGy  |5By_i  l|y_iG;.SyGy)tOy,  tOy)y.  (2l) 

This  proves  the  upper  bound  in  equation  (19)  since,  for  any  symmetric  matrix.  By, 


(Bj-iAy^j/y  AyGytOy,  Ay_j/|  AyGytOy)y_i 
||B,_,||y_i(G;SyGy«;y,tOy)y. 


\\Dih  = 


Wj  e  By 


(Bytoy,  tOy)y 
(toy,  toy )y 
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Let  7i  =  0  and  define  7*  recursively  as 

ik  =  \lGUn  +  'ik-i^k)Gk\\k- 

The  next  theorem  asserts  that  each  7*  is  a  bound  on  the  ib-grid  convergence  rate. 


(22) 


Theorem  3  For  every  k  >  2, 


\\Bt\h  <  'll.. 


Proof. 

From  the  definition  of  the  7’s,  we  see  that 

IIB2II2  =  72 

If  |||By_i||y_i  <  7j_i,  then  for  each  uy  €  Hj, 

<  (Gy(7y  +  |By_i|Jy_i5y)GyUy,  Uy)y 

=  (Gy(Ty  +  7y_i5y)GyUy,  Uy)y 

and  therefore  IjPylly  <  7y. 


In  order  to  compare  these  bounds  with  the  theoretical  bounds  of  Theorem  3.1,  we  define  a 
constant,  independent  of  the  number  of  grid  levels,  such  that 


f 


\ 


P  =  inf 
fc>i 


inf 

uk€Hit 


Y  TkGkttk^O 


-  icwin 

V  |T»G,«,|||  ) 


From  this  definition  we  see  that,  for  every  j  >  1, 


||Gy«y!|,U^ryGyUy||,*<||uy||,* 


or  equivalently. 


iTyGy«yi|}+^||5yGy«y||,*< 


1  +  ^ 


(23) 


(24) 
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T'lote:  The  constant  0  is  given  for  some  common  relaxation  methods  and  for  piecewise  (bi)linear 
finite  elements  (i.e.,  (bi)linear  interpolation  for  finite  differences)  in  [3j.  Equation  (23)  holds  for 
0  =  0  whenever  the  iteration  matrix  of  the  relaxation,  Gy,  is  a  contraction.  The  convergence  rate 
of  the  V-cycle  can  be  shown  to  be  bounded  away  from  one  only  when  equation  (23)  holds  for  a 
positive  0. 

Theorem  4  For  all  k  >  1, 


'1k<l/{l  +  0).  (25) 

Proof. 

Equation  (25)  holds  for  qfi  since  -yj  =  0  and  0  is  non-negative. 

Assume  7y_i  <  1/(1  -h  0)  for  j  >  2.  For  any  tuy  €  Hj,  equation  (24)  implies  that 

(Gj[Tj  +  7y_iSy)GyU;y,  tUy)y  =  jTjG  j  +  7y_  i  (GySyGytUy,  tUy)y 


Since  G*(Ty  +  7y_iSy)Gy  is  symmetric,  then  7y  <  1/(1  +  0)  by  definition  (22). 

Finally,  we  note  that  this  new  technique  has  another  useful  feature.  If  the  fc-grid  convergence 
rate  is  known,  then  the  k  -t-  1-grid  rate  can  be  estimated.  Thus,  if  the  convergence  rate  of  a  V-cycle 
for  a  certain  number  of  grids  is  known,  it  is  possible  to  predict  the  effect  of  adding  one  additional 
grid. 

In  the  next  section  we  show  how  to  calculate  the  convergence  rate  bounds,  7*. 


5.  Details  of  the  Fourier  Analysis 

For  certain  model  problems,  it  is  possible  to  calculate  exact  convergence  rates  of  the  two  grid 
V-cycle.  The  same  techniques  can  be  used  to  compute  the  Ik-grid  convergence  rate  bounds  of 
Theorem  4  for  the  symmetric  V-cycle. 

The  Fourier  mode  eip(i£*  x/Zi*)  on  level  k  appears  as  the  mode  eip(i2£‘  i/hfc_i)  on  level  Ik  -  1 
since  /i*  =  .Shk-i-  Therefore,  on  level  A:  —  1  it  coincides  with  every  Fourier  mode  eip(i£'-  x/h^)  for 
which  £'  =  ^{modn).  Thus  restriction  operators  introduce  coupling  between  each  lower  mode  £  and 
its  (2*^  -  1)  high-frequency  harmonics  {£'  ;  n/2  <  |£!^|  <  >r,£^  =  £(modjr)}.  Interpolation  introduces 
coupling  among  the  same  modes.  This  is  summarized  in  the  following  two  formulas 


^*-i«a:p(t^- z/h)  =  ^'*-i(£')«a:p{t£- z/h)  (26) 

£^=J(»nodT) 
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and 


/j  ^exp{i9l-^h)  =  ^h).  ^  =  6_{modT^).  (27) 

^fc-i(i)  called  the  symbols  of  and  lj^~^  respectively. 

Since  the  fine  and  coarse  grid  operators,  as  well  as  the  relaxation,  do  not  introduce  coupling  of 
more  Fourier  modes  we  conclude  that  the  two  level  cycle  has  the  2“^  harmonic  modes  as  its  invariant 
subapace.  Hence  the  convergence  properties  of  the  multigrid  cycle  can  be  studied  by  looking  only 
at  the  interactions  of  each  set  of  2“*  Fourier  components. 

Interpolation  and  restriction  can  be  represented  in  matrix  form  as 

■  ■ 

;  (28) 

and 

=  [?!-’(«')  ?»*■’(»’')],,,,■  (29) 

The  fine  grid  operator  is  represented  as 

■ 

Mi]=  ,  (30) 

•^t(£  )  .  2<<x2<‘ 

the  coarse  grid  operator  as 

Vi(29)=  [Vi(2£')]^^^,  (31) 

and  the  relaxation  matrix  as 

■  9{0}) 

Gk{0J=  (32) 

S(£*  )  .  2''x2'' 

In  terms  of  these  matrices  the  two  level  cycle  is  represented  by  the  following  2**  X  2^  matrix 

hW  =  [g»(«)]'’  [/  -  /J-i(«)(A,_,(2ffl)-'}‘-'(ei*(«)]  [G*(fl]'' .  (33) 

Take  the  simple  case  of  the  V-cycle  used  as  a  fast  Laplace  solver  on  the  unit  square.  A  few 
simple  relaxation  methods  (such  as  Richardson  or  damped  Jacobi)  can  be  easily  analyzed  for  this 


10 


particular  problem  simply  because  the  Fourier  modes  are  eigenvectors  of  the  relaxation.  For  this 
2  dimensional  problem,  the  two  grid  convergence  rates  are  obtained  by  computing  the  largest  (in 
absolute  value)  eigenvalue  over  all  the  4x4  matrices  given  by  formula  (33).  The  bounds  for  the 
convergence  rates  for  more  than  two  grids  are  computed  in  exactly  the  same  manner,  inserting  a 
constant  in  formula  (33),  preceding  the  interpolation  symbol,  in  order  to  obtain  the  7*  of  Section  4. 

For  completeness  we  include  some  examples  of  some  operators  and  the  elements  in  their  symbols. 
If  —  corresponds  to  the  five  point  Laplacian,  given  by  the  stencil 


AS)  _  JL 


-1 

-1  4  -1 

-1 


(34) 


then 


(5),..  _  4(8in^(gi/2)  +  3in^(g2/2)) 


(35) 


where  (^1,^2)- 

For  bi-linear  interpolation  and  the  residual  restriction  operator  which  is  its  adjoint  (usually 
called  full  weighting),  the  elements  of  the  symbol  matrices  are  given  by 


and 


_/l  +  cos^i,,l  +  cos02 


-)(■ 


)• 


(36) 


(37) 


*  '  2  '''  2 
A  simple  relaxation,  damped  Richardson  (which  is  the  same  as  damped  Jacobi  in  simple  cases 
we  consider),  the  elements  of  G*(£)  are  given  by 

(7(£)  =  l-2a;cAfc(£)  (38) 

where  c“^  =  sup^  At(^  and  0  <  w  <  1. 

When  the  coarse  grid  operators  are  determined  “variationally” ,  i.e.,  A*_i  =  then 

4 


At-im = E 


(39) 


•=i 


If  is  a  nine  point  discrete  Laplacian,  given  by  the  stencil 


4(9)  _  J_ 

‘  "Shi 


-1 

-1 

-1 

-1 

8 

-1 

-1 

-1 

-1 

(40) 
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then 


®  “  2cos(^i)  -2cos(^2)  -  4cos(0i)cos(02) 

®  = - wj - 

f9) 

If  is  given  by  the  corresponding  stencil  on  the  hk-i  grid: 


.(9)  _  1 


1  -1 

-1  8 

1  -1 


then 


(41) 


(42) 


8  -  2cos(2tfi)  —  2003(2^2)  —  4  cos(20i)  cos(202) 
3^t-i 


(43) 


This  coarse  grid  operator,  though  corresponding  to  the  same  stencil  as  the  fine  grid  operator,  is  in 
fact  also  the  “variational”  coarse  grid  operator  when  using  bi-linear  interpolation  and  full  weighting. 
This  is  convenient  when  trying  to  use  the  variational  theory  but  trying  to  keep  the  symbols  of  the 
discrete  operators  simple. 


6.  Results  and  Comparisons 

In  [2],  it  is  observed  that  the  variationally  derived  bounds  are  too  pessimistic,  at  least  for  typical 
parameters  in  a  multigrid  V-cycle  when  using  a  modest  number  of  grids.  Although  in  Section  4 
we  prove  that  the  fc-grid  bounds  are  smaller  than  the  grid  independent  bounds  of  the  variational 
theory,  it  is  not  known,  in  general,  how  much  better  the  new  bounds  are.  The  limit  of  the  bounds, 
7*,  as  fc  goes  to  infinity,  does  not  always  degrade  to  the  theoretical  rate  of  1/(1  +  /3).  For  a  modest 
number  of  grids,  the  new  estimates  are  much  closer  to  the  actual  convergence  rates. 

Moreover,  we  note  that  this  new  technique  has  another  useful  feature.  If  the  Jb-grid  convergence 
rate  is  known,  then  the  k  +  1-grid  rate  can  be  estimated.  Thus  it  is  easy  to  predict  the  effect  of 
adding  an  extra  grid  to  a  given  multigrid  cycle. 

Consider  the  simplest  case  of  a  one  dimensional  problem  given  by 

=  /  on  (0,1)  (44) 


<Pu 

dx^ 


u(0)  =  a  ;  u(l)  =  b 
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0.50 


0.4  5 


^  of  grids,  k 


Figure  1:  The  convergence  rate  bounds  for  the  one  dimensional  model  problem 


Define  a  V^-cycle  using  the  standard  three  point  discretization  of  the  second  derivative,  linear 
interpolation  and  damped  Jacobi  (with  w  =  2/3)  for  the  relaxation.  The  convergence  rate  bounds 
predicted  in  Section  4  for  a  V(l,  1)  cycle  (one  pre-  and  one  post-relaxation)  are  given  in  Figure  1. 
The  7*  are  shown  as  a  function  of  the  number  of  grid  levels,  k.  In  contrast,  the  variational  theory 
gives  a  convergence  rate  bound  equal  to  0.408,  see  [2]. 
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Tables  1  and  2  compare  the  exact  three  grid  convergence  rates  (computed  with  a  three  grid 
Fourier  analysis)  to  the  bounds  predicted  by  our  theory.  For  the  optimal  u>,  <jj  =  2/3,  the  bounds 
stay  close  for  ri  =  r2  =  1 ,  ■  •  • ,  4. 


ri 

r2 

u  =  1/2 

a;=  2/3 

II 

CO 

1 

1 

.2665 

.1655 

.2499 

2 

2 

.1086 

.0826 

.0903 

3 

3 

.0743 

.0562 

.0539 

4 

4 

.0570 

.0430 

.0392 

Table  1:  One-dimensional  exact  three  grid  convergence  rates  of  V’(ri,r2)  using  damped  Jacobi  with 
damping  parameter  w 


ri 

*■2 

II 

3 

w  =  2/3 

w  =  3/4 

1 

1 

.2667 

.1667 

.2499 

2 

2 

.1161 

.0887 

.0984 

3 

3 

.0804 

.0610 

.0582 

4 

4 

.0617 

.0466 

.0425 

Table  2:  One-dimensional  estimated  three  grid  convergence  rates  of  V(ri,r2)  using  damped  Jacobi 
with  damping  parameter  oj 
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Finally,  for  Poisson’s  equation  with  Dirichlet  boundary  conditions  on  the  unit  square,  we  com¬ 
pare  our  bounds  to  the  asymptotic  convergence  rates  seen  experimentally.  Using  the  grid  sizes 

indicated  in  the  first  column  of  table  3,  we  ran  experiments  using  a  damped  Jacobi  relaxation,  the 

(9) 

nine-point  discretization  of  the  Laplacian,  ’  as  given  in  Section  5  and  bilinear  interpolation  and 
full  weighting.  Starting  with  a  random  initial  error,  the  V'(l,  1)  multigrid  cycle  was  used,  rescaling 
the  error  after  every  cycle  in  order  to  see  the  asymptotic  convergence  rate.  The  center  column 
contains  the  bounds  given  by  our  method.  The  grid  independent  bound  given  by  the  variational 
theory  is  0.40,  see  [3]. 


grid  sizes 

our 

bounds 

worst  case- 
experimental 

/i=  (1/4, 1/2) 

.110 

.110 

h=  (1/8, 1/4, 1/2) 

.217 

.211 

/i=  (1/16,1/8,1/4,1/2) 

.258 

.241 

/i  =  (1/32,1/16,1/8,1/4,1/2) 

.286 

.246 

h=  (1/8, 1/4) 

.206 

.206 

h  =  (1/16, 1/8, 1/4) 

.254 

.239 

h  =  (1/32,1/16,1/8,1/4) 

.284 

.245 

/»  =  (1/16, 1/8) 

.238 

.238 

h=  (1/32,1/16,1/8) 

.275 

.244 

Table  3:  Comparison  of  bounds  with  actual  rates  for  two-dimensional  Laplacian  (9  pt.  stencil) 
using  damped  Jacobi  with  damping  parameter  .75  and  r  =  1.  The  grid  independent  bound  is  0.40. 
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